Research Team Optimizes Code to Push Nuclear Fusion to the Next Level

Published August 15, 2024

By ORNL and SDSC Communications

Nuclear fusion — when two nuclei combine to form a new nucleus, thereby releasing energy — may be the clean, reliable, limitless power source of the future. But first, scientists must learn how to control its production. And while experimental methods are essential for gathering new operational modes for fusion reactors, simulations are used to validate basic theory, plan experiments, interpret results on present devices and design future devices.

A multi-institution team of researchers — including Igor Sfiligoi of the San Diego Supercomputer Center (SDSC) at UC San Diego alongside Jeff Candy and Emily Belli at General Atomics — have been working on the development and maintenance of the open-source CGYRO simulation tool, which is optimized for predicting temperature fluctuations driven by turbulence on leadership-class supercomputers. This tool was recently used to discover an unexpected feature of multi-scale turbulence in the edge of a fusion reactor’s plasma.

While Candy and Belli developed the physics algorithms in CGYRO that drive the plasma simulation, Sfiligoi was responsible for porting and optimizing the code so that the simulation ran properly on modern systems. This includes the AMD MI250X GPU-based Frontier exascale supercomputer at the Department of Energy (DOE) Oak Ridge National Laboratory (ORNL).

“The compute landscape of leadership-class supercomputers is in continuous evolution and science codes must adapt to this change to be useful,” explained Sfiligoi, lead scientific software developer and researcher at SDSC. “In recent years, GPU-based computing has become the major performance driver with CGYRO as one of the early adopters of this compute paradigm.”

Sfiligoi explained that the original port was optimized for NVIDIA GPUs, so additional work was needed to run on datacenter-class AMD and Intel GPUs. “The initial choice of a pragma-based offloading approach definitely paid off, allowing us to run on ORNL systems within weeks of gaining access,” he said.

Why is This Important?

An open problem in fusion science is handling the confinement of superhot plasma within tokamak fusion reactors. Tokamaks are systems that employ massive magnetic coils around a donut-shaped chamber to control charged plasma particles formed from hydrogen fuel. Confinement in tokamaks is limited by the small but steady heat loss caused by turbulence — the same effect that leads to unsteady flight in planes or the complicated swirls of cream in your coffee.

One important method to improve tokamak confinement is a byproduct of the commonly used neutral beam injection, or NBI, system. NBI uses an intense particle beam to heat the plasma to 150 million degrees Celsius — 10 times hotter than the core of the sun — for fusion to occur. In addition to heating the plasma, this beam also causes the plasma to rotate around the tokamak’s chamber. This rotation was universally believed to improve the quality of confinement.

However, the research team recently discovered surprising results from a precise exascale simulation of turbulence in the plasma edge, close to the tokamak’s outer walls. Their results have been published in a paper published in Plasma Physics and Controlled Fusion.

“The plasma edge region is really important because it sets the global confinement of energy and heat in the plasma. But calculating the turbulence in this edge region is very difficult. To do this, you must capture the subtle interaction between very heavy ions and very light electrons — an interaction that is frequently ignored,” said Emily Belli, a physicist at General Atomics in San Diego and lead author of the paper. “When scientists did previous simulations in this edge region, they were limited computationally and could only have the ion physics or only have the electron physics. They couldn’t describe the complex interplay between the two. This became possible for us with Frontier.”

With team members Candy of General Atomics and Sfiligoi of SDSC — and supported by an allocation of computing time from the DOE Office of Science’s Innovative and Novel Computational Impact on Theory and Experiment, or INCITE, program — Belli carefully studied this ion-electron interaction in the edge region. Using the CGYRO gyrokinetic code, along with data from DOE’s DIII-D National Fusion Facility, the team modeled the effect of plasma rotation on both ions and electrons. Previous studies had indicated that rotation would reduce the turbulence caused by ions. It was also theorized that the rotation would not affect the electrons because they are so light and fast. This study’s results contradict that theory.

“We found that when you include the interaction between the ions and the electrons, the rotation can increase the overall level of turbulence, which subsequently reduces the quality of confinement,” Belli said. “While the ions’ turbulence is favorably reduced, the total turbulence can actually increase, and that’s unfavorable for a reactor.”

The team’s findings could help to optimize the design of future tokamaks, including ITER, the international collaboration in France to build the world’s largest tokamak. “We might consider different ways to heat the plasma or different scenarios to operate the tokamak to keep us away from operating regimes where confinement is degraded by this new mechanism,” Belli said.

Additional Findings

The team also studied the effects of using different isotopes in the hydrogen plasma fuel.

Specifically, they simulated operation with an even split of deuterium and tritium mix, or DT, which will produce the maximum fusion reaction rate. ITER plans to use this DT mix once its reactor is commissioned, targeted for 2025. Tritium is not common and is difficult to work with because it is radioactive, making experiments rare. But in February, the United Kingdom Atomic Energy Authority’s Joint European Torus, or JET, tokamak produced a record-breaking 69 megajoules of sustained fusion energy for 5 seconds using DT. The fact that JET achieved this milestone using DT fuel demonstrates that this approach is feasible and provides valuable data for ITER and future fusion experiments.

The team’s performance prediction for DT matched the JET experiment’s results, validating CGYRO’s ability to capture the correct physics in the fusion process. “We were able to find that, in this regime, the DT plasmas will have better confinement than the deuterium plasmas. That’s an important result going forward because it predicts that when ITER does use this 50-50 DT, the performance will be better than what we are getting in the deuterium experiments,” Belli said.

CGYRO saw a fivefold performance increase going from the petascale — a quadrillion or more calculations per second — Summit supercomputer to the exascale —a quintillion or more calculations per second — Frontier supercomputer, both managed by the Oak Ridge Leadership Computing Facility, a DOE Office of Science user facility located at ORNL. Note that the two supercomputers employ drastically different architectures, the former being based on NVIDIA GPUs while the latter offering AMD GPUs, so being able to swiftly and effectively port the code was essential.

The large increase in computational power enabled the multi-institutional team to increase the simulation’s grid resolution and accurately capture the interactions between the hydrogenic fuel ions and electrons.

What’s Next?

“Fusion is a nonlinear process, with many tightly coupled physics components. We need a supercomputer to keep track of the subtle interactions between components that have a real impact on the fusion performance,” Belli said. “All the effects that we accounted for in our simulation were not always in agreement with the simpler theories that you get from analyzing the various components in isolation.”

Belli and her team are continuing their INCITE research project on Frontier, now studying the effect of impurities on plasma performance in fusion reactors. “The tokamak wall is made from metal, and particles from it can come into the plasma, potentially diluting it or causing unwanted radiation, and decreasing its performance. But with the power of Frontier, we’ll be able to capture these multiple-ion effects,” Belli said.

UT-Battelle manages ORNL for DOE’s Office of Science, the single largest supporter of basic research in the physical sciences in the United States. DOE’s Office of Science is working to address some of the most pressing challenges of our time. For more information, visit energy.gov/science.

About SDSC

The San Diego Supercomputer Center (SDSC) at UC San Diego is one of the nation’s premier centers for high-performance and data-intensive computing, with expertise in computing systems, turning bytes into knowledge, translating research into impacts, accelerating science through training and user support, and development and operations of immersive virtual environments that engage millions of researchers, educators and students every year.